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(57) Abstract 

An object code expansion program (5) inserts new 
instructions and data between preexisting instructions 
and data of an object code file (1); offsets are modified to 
reflect new positions of the preexisting instructions and 
data. For each item of preexisting object code (instruc- 
tions or data), the following steps are performed: making 
a new code block comprising any desired new instructions 
and the item, and storing it as new object code; tracking 
the location of the item and the new code block within the 
new object code; and tracking items that contain inter- 
item offsets. Then, each inter-item offset is updated using 
the new location of the item or new code block, as re- 
quired. Finally, offsets in symbol tables and relocation 
structures are updated with the new location of the item. 
This expansion program is used to add instructions to ob- 
ject code files to monitor memory accesses of another pro- 
gram. 
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5 METHOD AND APPARATUS FOR MODIFYING RELOCATABLE 

OBJECT CODE FILES AND MONITORING PROGRAMS 

BACKGROUND OF THE INVENTION 
The present invention relates generally to a method 
10 and apparatus for modifying relocatable object files. In 
particular, the present invention relates to a method for 
inserting additional instructions and data into an existing 
relocatable object file of a computer program, for any purpose. 
Most particularly, this purpose is to monitor memory access by 
15 the computer program. 

Despite the recent increase in CPU speeds and 
software complexity, most programmers continue to rely on 
development tools that were designed over fifteen years ago and 
that have not changed significantly since then. These 
20 development tools have serious inadequacies that exacerbate the 
difficulties of developing large, complex programs. 

Problems with developing applications in C/C++ are 
often more serious than with other programming languages, but 
are fairly typical. C/C++ 1 s pointer and memory management 
25 facilities make it difficult to build large, robust programs. 
Prudent C/C++ programmers currently hesitate to use many 
commercial object code libraries because they are worried they 
may lose weeks of time later on in tracking down wild-pointer 
bugs introduced by their particular use of a given library. 
30 The difficulty in tracking down these kinds of programming bugs 
and many others is directly tied to the manner in which 
executable code is created from source code and to the 
inadequacies of current development tools. 

The process of transforming source code into 
35 "executable" code is, briefly, as follows. The source code for 
a typical computer program is divided into many files. Some of 
£hese files may contain high-level language code, such as C, 
C++, Pascal, Fortran, Ada, or PL1, and some may contain 
assembly language code. Each high-level language file is 
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translated by a language-specific compiler into either a 
relocatable object file, or into an assembly language file. An 
assembler translates the assembly language files into 
relocatable object files. A linker merges all of the 
5 relocatable object files into a single executable program. 

As programs get larger and more complex, they become 
more difficult to test and debug. If one wants to monitor or 
analyze aspects of a program's behavior, the current practice 
is to have the compiler output the extra instructions required 

10 to implement the desired monitoring. One example of this 

exists in many Pascal compilers; there is typically a way to 
request the compiler to output the extra instructions required 
to check array bounds at run time, and to signal an error if 
there is a violation. Another example exists in many Unix/C 

15 compilers; most compilers will, upon request, output extra 

instructions to record how many times each function was called. 

The approach of having the compiler output the extra 
instructions required to implement a monitoring or analysis 
scheme is, however, flawed in at least three significant ways: 

20 First, modifying the compiler to output new sequences is 

difficult, and in practice, nearly impossible, because most 
programmers don't have the source code to the compiler. 
Second, recompiling all of a program's files just to get the 
extra instructions inserted can be very time consuming and 

25 wasteful. Finally, not all code goes through a compiler; some 
is written in assembly language and does not get the new 
instructions inserted into it. Thus, any monitoring which 
requires complete coverage to work correctly cannot be 
implemented through only the compiler. 

30 

Some of the most vicious development problems relate 
to the difficulty in finding and eliminating a large class of 
memory-access related errors. Among the most important memory- 
access related errors that a programmer needs to detect are 
35 array bounds violations, uninitialized memory reads, free 
memory access, and data changing strangely. 

Array bounds violations (where an array is any 
collection of data contiguous in memory) occur on those 
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occasions when a program reads or writes past the end, or 
before the beginning, of an array and accesses whatever datum 
happens to be in that memory location. 

Uninitialized memory reads happen when a program 
5 allocates some memory for data storage, but fails to initialize 
it completely. Later, an uninitialized portion is read, 
unintentionally providing a random value, which might sometimes 
cause to the program to fail, and sometimes not. 

Free memory access describes the situation where a 
10 program deallocates some memory but incorrectly continues to 
use it. If the program reallocates that memory for another 
purpose, then it will be using the same memory for two 
different purposes, and the program will probably perform 
incorrectly . 

15 "Data changing strangely" is a bit of a catch-all 

expression. Often there are many ways to change a datum, 
especially a "global" datum. The programmer can have a 
difficult time discovering which function is changing the datum 
incorrectly, in a given run of the program. What the 

20 programmer needs is to have a monitoring program tell him or 
her whenever a specified datum changes (this is called a 
watchpoint) . 

A comprehensive way to monitor the execution of 
today's and tomorrow's programs, in particular their memory 
25 access, is clearly needed by the program developer. 

SUMMARY OF THE INVENTION 
According to one aspect of the invention, an object 
code file is expanded by inserting additional instructions 
30 and/or data between preexisting instructions and data, which 
may also be modified in some ways. A basically unlimited 
variety of additional instructions and data can be inserted for 
' an equally wide variety of purposes. After the insertion step, 
the offsets in the file are checked and modified, if necessary, 
35 to reflect the new positions of the preexisting instructions 

and data, so that the expanded code will execute properly. In 
the preferred embodiment additional offsets in symbol tables, 
data relocation tables and instruction relocation tables are 
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updated in the same general manner as the other offsets. The 
basic method is as follows: 

An old object code table is formed in memory space, 
containing the preexisting instructions and data. Space is 
5 also allocated for other tables: a new object code table, an 
inter- item offset table, a forward index table, and a forward 
control index table. For each item in the old object code 
table (whether instruction or datum) , the following four steps 
are performed: (1) making a new code block comprising any 

10 desired additional instructions and/ or data and the item, and 
storing it into the new object code table; (2) storing the 
location of the item within the new object code table into the 
forward index table; (3) storing the location of the new code 
block within the new object code table into the forward control 

15 index table; and (4), for items that contain inter- item 

offsets, storing the location within the old object code table, 
of the offset and the base from which it is measured, into the 
inter- item offset table. Then, for each pair of offset/base 
locations in the inter- item offset table, the offset stored in 

20 the new object code table is updated using the index tables. 
Finally, the offsets in any symbol tables, instruction 
relocation structures, or data relocation structures in the old 
object code file are updated so that the new offset refers to 
the location in the new object code table to where the item 

25 referred to was moved. 

According to a second aspect of the invention, all or 
substantially all the memory accesses of a given program are 
monitored (not including the memory accesses for instruction 
fetch) , for the purposes cf. performing error-checking . In one 

30 embodiment, all the object code files for an executable program 
are processed, and instructions are added to implement the 
following monitoring scheme. A memory status array is 
established, with an entry for most memory locations that are 
validly accessible by the program. Each entry indicates the 

35 state of the corresponding memory location, and the state can 
be one of the following three: unallocated and uninitialized, 
allocated but uninitialized, and allocated and initialized. 
Before each preexisting instruction which accesses memory or 
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which can change memory status, extra instructions are added to 
maintain the memory status array, and to use the memory status 
array to check for the errors of writing to unallocated memory 
and reading from unallocated or uninitialized memory. In one 
5 particular embodiment, the data sections of the object code 

files are expanded with extra dummy entries between each datum. 
These extra entries are assigned the status of unallocated and 
uninitialized, and aid in the detection of array bounds 
violations and similar data errors. In another particular 

10 embodiment, a list is stored of memory or datum locations which 
are to be watchpoints with which more comprehensive monitoring 
is to be performed. 

A further understanding of the nature and advantages 
of f the invention may be realized by reference to the remaining 

15 portions of the specification and the drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 
Fig. 1 is a block diagram a relocatable object file 
being expanded by an embodiment of the invention into a new 
20 relocatable object file; 

Fig. 2 is a block diagram showing the relationship 
between a relocatable object file and an old object code table; 

Fig. 3 illustrates the general data/ instruction 
insertion method; 

25 Fig. 4 is a flowchart of the general data/ instruction 

insertion method; 

Fig. 5 illustrates the general procedure for 

implementing a monitoring scheme by modifying the object files 

for an executable program. 
30 Fig. 6 illustrates the different memory access states 

used in a particular embodiment of the invention directed to 

tracking memory access of a program; 

Fig. 7 is a virtual memory map showing the portions 

of virtual memory available to a program; 
35 Fig. 8 illustrates how calls to operating system 

routines are handled under an embodiment of the invention 

cfirected to memory access monitoring; 
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Fig. 9 illustrates how the object files for an 
executable program are processed by an embodiment of the 
invention directed to memory access monitoring; and 

Fig. 10 illustrates the formation of new code blocks 
5 to implement the memory access monitoring of the preferred 
embodiment. 



DESCRIPTION OF THE PREFERRED EMBODIMENT 



10 



A-rbitrarv Instruct -ion Insertion 

One aspect of the present invention is a method for 
expanding a relocatable object file, typically by inserting new 
instructions and data between preexisting instructions and data 

15 of the file, without recompilation being necessary. Fig. 1 
illustrates a preexisting object code file 1 ("oldf ile.o") 
being augmented by expansion means 5 to form a new object code 
file 1' ("newf ile.o") . In the preferred embodiment, expansion 
means 5 is a general purpose computer having a memory and 

20 operating under the control of a computer program. Since 
expansion means 5 takes object files as input, monitoring 
schemes can be comprehensive; the method can be applied to all 
code that goes into the final executable product, not just 
those portions for which source code is available. 

25 The particular embodiment of expansion means 5 

described herebelow is designed for a Sun3/60 running 
Sun OS 4.1.1, using the C/C++ compilers available from Sun 
Microsystems, Inc., of Mountain View, California, so the 
description is particular in some respects to that system. In 

30 that system, a standard format for relocatable object file 1 
(.o file) has 7 parts, as shown in Fig. 2: 

• A 32 byte header 11, which describes the lengths of 
the other parts. 

• Binary machine instructions 12a. 
35 • Binary data 12b. 

• Symbols 13, which have a name (an index into the 
string section) , a type, a value, and other minor 
fields . 
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• Instruction relocation data structures 14 , which 
specify which bytes in the instruction section are 
unresolved references to other data or functions. 

• Data relocation data structures 15, which specify 
5 which bytes in the data section are unresolved 

references to other data or functions. 

• Strings 16, the names of the symbols. 

The pre-existing instructions will generally contain many 
references to other instructions in terms of offsets; that is, 

10 in terms of the number of bytes separating the instructions in 
the object code file. When new instructions are inserted into 
the code, these offsets are corrected by expansion means 5. 
Simply modifying instructions, as opposed to adding new ones, 
may lengthen or shorten the instruction and also require 

15 offsets to be corrected. Furthermore, the instructions, 

symbols, and relocation structures also contain references to 
data and instructions, and these references will often be in 
the form of an offset from the beginning of the object file 
section which contains the data and instructions. These are 

20 updated in a similar manner. 

The value field of certain symbols is an offset into 
the preexisting instructions and data, and thus must be 
replaced with the offset of the location to which the 
preexisting item has been forwarded. The symbols that need 

25 updating are those whose type field is one of: N_TEXT, N_BSS, 
NJDATA, N_STSSYM, NJLCSYM, N_S0, N_S0L, NJENTRY, N_LBRAC, 
*N_RBRAC AND N_EC0MM. These, symbol types are defined in the 
Sun-supplied include file /usr/include/stab.h (in which "text" 
generally refers to instructions) . Relocation structures have 

30 a field named "r_address" which (like the value field of 

symbols) is an offset into the preexisting instructions and 
data and must be updated with the new location to where the 
bytes originally pointed to have been moved. In addition, for 
local relocations, the bytes pointed to by the "r_address" 

35 field are themselves an offset that must be updated. 

The extra instructions inserted are often associated 
with particular pre-existing instructions and must be executed 
every time that pre-existing instruction is executed, in some 
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cases just before that pre-existing instruction is executed. 
Some of the references to instructions in preexisting object 
code file 1 will be offsets used to transfer program control to 
those points during execution. In this case the instruction 
5 offsets are adjusted to point to the beginning of the extra 
code associated with that pre-existing instruction. In other 
cases, such when a references points to data, even if extra 
data is inserted around a particular datum, the reference may 
still need to point directly to that datum. The data and 

10 instructions are generally treated as one section. References 
to both data and instructions are indexed from the beginning of 
the section containing the instructions and data. Data may be 
intermingled with instructions, as well. Expansion means 5 
determines whether a particular value in the object file is a 

15 datum or an instruction, and also determines the purpose of 
each reference offset. Furthermore, compilers often put 
unnamed data, such as constants referred to in the source code, 
into the instruction section, but not inside a function. To 
differentiate this data from actual instructions a simplified 

20 dead-code analysis is used, starting from the named entry 

points specified by the symbols of type N_TEXT and the entry 
points derived from the instruction relocation structures. Any 
instructions that cannot be reached are considered to be data. 
One exception is that some object code libraries of at least 

25 one earlier Sun OS, 4.03, have several named entry points of 

type N_TEXT that are data, not entry points, and are therefore 
ignored for these purposes. The names of these data are 

" BYADDR" , '^NETGROUP" , " ypsleeptime" , and 

ii ypserv_timeout" . Another exception is that at least one 

30 compiler, gcc (from the Free Software Foundation) , puts named 
constant data into the instruction section. If the object file 
was compiled by gcc, the first word of each named entry point 
is checked. If it is a link instruction, the entry point is 
considered a function; otherwise, data. 

35 The instruction insertion process of expansion means 

5 will now be described in detail with reference to 
Figs. 2-4. Fig. 2 shows a layout in storage media of a 
relocatable object file 1 containing a section 12 of 
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instructions 12a and data 12b. Section 12 is copied into a 
block of memory allocated for the old object code table 2 0 (see 
FILES. C, "Initialize"). Each item in table 20 is indicated 
generally by a horizontal line, and the byte location for each 
5 item is shown to the left side (note: byte locations are shown 
in decimal) ; different items may have different lengths. 
Expansion means 5 allocates memory for other tables, shown in 
Fig. 3: a new object code table 30, a forward index table 40, a 
forward control index table 50, and an inter-item offset 
10 table 60, described below. Then, starting at the beginning of 
the old object code table 20, each entry in table 20 is 
processed. 

Fig. 4 shows a general flowchart for the method 
performed by expansion means 5. Block 100 indicates the 

15 preparation of tables 20, 30, 40, 50 and 60, described above, 

and block 110 indicates the step of identifying entry points to 
functions (see INSERT. C, "FindFunctions") . Block 115 indicates 
the expansion of all functions; the details of the expansion 
process performed on each function are shown in the loop 

20 composed of blocks 120-190 (see INSERT. C, "DoOneFunction") . 

In step 120 of Fig. 4, the first item in the old 
object code table is selected. Fig. 3 shows parts of memory 
affected during steps 130 to 200 of the expansion process. 
Locations (bytes) 1 to 125 of table 20 have already been 

25 processed, and occupy locations 1 to 181 of new object code 

table 30. The next entry (an object code instruction within a 
function, indicated by its mnemonic "BEQ +6") at location 12 6 
in old object code table 20 is then processed at step 130. 
This is a four byte instruction; it begins at location 126, and 

30 the next instruction begins at location 126 + 4 = 13 0 

(decimal) . Two opcode bytes are shown simply as BEQ, and the 
"6" is a two byte offset pointing to the "RTS" instruction 
• beginning at location 132. Expansion means 5 forms a new code 
block 33 (see INSERT. C, "DoOnelnstruction" ) , containing just 

35 the BEQ statement because no additional instructions or data 
are inserted. The offset is indicated by a question mark in 
table 30, because its new value is not yet known. Expansion 
means 5 allocates the maximum of four bytes for the offset, 
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even though the original offset was only two bytes (and the BEQ 
opcode is slightly modified to correspond to a four byte 
offset) . This is done because after expansion, the new offset 
might be too large for the number of bytes of the previous 
5 offset. 

Referring to Figs. 3 and 4 together, in step 140 the 
location of the BEQ instruction within new object code table 30 
(location = 182) is stored into location 126 of a forward index 
table 40. In general, the new location of each byte of an 

10 instruction is stored in table 40, but in this case, the only 
entries that are significant are at location 126 of table 40, 
which indicates that the BEQ statement now begins at location 
182 of table 30, and location 128 of table 40, which indicates 
that the offset of the BEQ statement now begins at location 184 

15 of table 30. The ellipses ("...") indicate that one or more 
values are present but have no significance. For example, 
location 129 of table 40 would correspond to the second byte of 
the BEQ offset, at location 129 to table 20; however, the 
offset gets expanded from two bytes to four, so the individual 

20 bytes of the offset cannot be indexed separately. 

Next, in step 150, the location of new code block 33 
(location = 182) is stored in forward index control table 50. 
Even though there is space for the new locations for each byte 
of the BEQ 6 statement, only the location of the beginning of 

25 the statement is significant. Note that in some expansion 

schemes, the preexisting instruction might always be located at 
the beginning of the new code block, in which case the same 
information would be recorded in both forward index table 40 
and in forward control index table 50; dual recordation of this 

30 information would, however, be a waste of space. The best 
approach, therefore, envisions a forward table which, as 
explained above, may or may not need to include the two 
separate sub-tables, forward index table 40 and forward control 
index table 50. 

35 Next, in step 160, expansion means 5 determines that 

this instruction contains an inter-item offset (an inter-item 
offset is a reference to an instruction or datum expressed in 
terms of its distance in bytes from a second instruction or 
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datum) . This determination is made by examining the opcode of 
the instruction (see INSERT. C, "RecordPcRellnstr") . Since this 
instruction contains an inter-item offset, step 170 is 
performed, whereby the old location of the offset (128 in table 
5 20) , the old location of the base from which the offset was 
measured (126 in table 20) , and the old size of the offset (2 
bytes) are all stored in inter-item offset table 60. For any 
instruction which denotes the beginning of a switch table of 
inter-item offsets, each offset is stored in table 60 as above, 

10 with the beginning of the switch table entered as the base (see 
INSERT. C, "DoSwitchTable") . In step 180 the loop is repeated 
if any unprocessed items remain. Since there are still more 
unprocessed items in table 20, step 190 selects the next item, 
"Add 1,(A0)", and the loop is begun again at step 130. 

15 Repeating steps 130-180, expansion means 5 forms a 

new code block 35 from the add instruction and new instructions 
a, B, and 7, which in this particular case precede the add 
instruction. This new code block is stored at location 188 of 
new object code table 30, with the add instruction located at 

20 location 194. The location of the add instruction within new 
object code table 30 (location = 194) is stored into location 
13 0 of a forward index table 40. This indicates that the item 
which was in location 130 of old object code table 20 is now in 
location 194 of new object code table 30. The location of new 

25 code block 35 within new object code table 30 (location = 188) 
is stored in location 130 of forward control index table 50. 
This indicates that the new code block formed from the item 
located at entry 130 of old object code table 2 0 is located at 
entry 188 of new object code table 30. The add instruction 

30 does not contain an inter-item offset, so nothing is entered 
into table 60. 

Now this cycle is repeated for the next item in old 
object code table 20, "RTS" (return from subroutine) at 
location 132. A new code block 37 is formed, but it is 

35 determined that there are no new instructions to be inserted 

with the return instruction, so new code block 37 consists only 
of the return instruction. New code block 37 is stored at the 
next available location within new object code table 30, 



WO 93/00633 PCT/US92/04672 

12 

location 198. The location of the return instruction within 
new object code table 30 is stored into location 132 of forward 
index table 40; the location of new code block 37 within new 
object code table 30 is stored in location 132 of forward 
5 control index table 50. Since the return instruction and new 
code block 37 are the same, the number 198 gets stored into 
location 132 of both index tables. In this example, the return 
instruction does not contain an inter-item offset, so nothing 
is stored in inter- item offset table 60. Unnamed constant data 

10 is sometimes stored in between functions, after the last 

instruction of a function and before the next entry point; it 
may be processed as desired or simply copied directly into the 
new object code table. 

After steps 120-190 have been done for all items in 

15 all functions, step 195 repeats the expansion process of blocks 
120-190 for all named data. The expansion process is somewhat 
simpler for data because it does not contain any offsets such 
as handled by blocks 160-170. Next, in step 200, expansion 
means 5 corrects the inter-item offsets (see PATCH. C, 

20 "PatchPcRel") . The inter-item offset table is examined, and 

for each set of offset/base locations in that table, the inter- 
item offset is patched by: first, adding the indicated offset 
to its base to determine which item in old object code table 20 
Was targeted by the offset; next, looking up the new location 

25 of the targeted item, using forward control index table 50 if 
the offset is used for program control transfer (such as a jump 
or call), and using forward index table 40 otherwise; also, 
looking up the new locations of the offset and base, using 
forward index table 40; and, finally, patching the offset in 

30 new object code table 30 with the difference between the new 

location of the targeted item and the new location of the base. 

in this particular example, step 200 involves the 
offset/base pair of 128/126. The offset is looked up at 
location 128 in table 20, where the value 6 is found. This is 

35 added to the base of 126 to yield a target location of 132. 
Because this offset is used in a program control transfer 
statement (branch) , the new target location is looked up in 
table 50, which provides a new target location of 198. The new 



WO 93/00633 



PCT/US92/04672 



13 

offset and base locations are looked up in table 40, providing 
a new base location of 182 and a new offset location of 184. 
The difference of 198 minus 182, 16, is then stored at the new 
offset location, 184. This process is repeated for all entries 
5 in table 60. 

Next, if the object file contains any symbol tables 
or relocation tables which are to be corrected, these are 
analyzed item by item in step 210, and corrected by replacing 
old item locations with new item locations, as explained above 

10 (see also PATCH. C, "PatchTextReloc" and "PatchdataReloc") . The 
new item locations are looked up in forward index table 40 
(except for debugging symbols, the new locations for which are 
looked up in forward control index table 50). A new object 
code file 1' is now written, using the new object code table as 

15 the data/ instruction section, using the new symbol and 
relocation tables if corrected, and using the remaining 
information from the old object file 1. 

Memory Acces s Monitoring 

20 This aspect of the invention is directed to a process of 

tracking reads and writes of memory by an application program. 
In the preferred embodiment, all object files of the 
application program are processed by a memory monitor equipping 
program that uses the above described expansion means and 

25 data/ instruction insertion process to insert a function call 
before every instruction that includes a memory access, and 
'before some instructions that change the stack pointer. All or 
substantially all of the memory accesses of a given program 
(not including the memory accesses for instruction fetch) are 

30 thereby monitored, for the purposes of performing error 

checking. All of the object code files for an executable 
program are processed (except for a library of routines to be 
added by the memory monitor equipping program) , and 
instructions are added to implement the monitoring scheme 

35 described below. 

The general procedure of implementing a monitoring 
scheme to discover errors in an executable program, by 
modifying all of the object code files for the executable 
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program, linking the modified program and then running it, is 
illustrated in Fig. 5. A first object file or library for the 
executable program is selected in block 3 00. If the file is 
determined to be a simple object file rather than a library, in 
5 block 310, then the object file is processed in block 320 to 
implement a monitoring scheme, by the expansion process 
described above; also, functions within the object file may be 
renamed, as described below. If the file is determined to be a 
library in block 310, then each object file that contributes to 

10 the library is processed in block 330, in the same manner that 
a simple object file is processed by block 320. Then, in block 
340, the library is rebuilt from the modified object files. 
After the object file or library has been processed, block 350 
determines if any unprocessed files remain for the executable 

15 file. If so, block 360 selects an unprocessed file and then 
the steps of blocks 310-350 are repeated. Once it is 
determined in block 350 that all files for the original 
executable program have been processed, all necessary linkage 
is performed in block 370, which may include linkage with an 

20 extra library file including functions specially designed for 
the monitoring scheme. The program is then executed in block 
380; during this execution, the monitoring added by the 
expansion process is performed. 

In the memory access monitoring method of the 

25 preferred embodiment, the expanded code establishes a memory 
status array with an entry for most memory locations validly 
accessible by the program, in which two-bit array entries are 
allocated for each such memory location. Each entry indicates 
the state of the corresponding memory location, and the state 

30 can be one of the following three: (1) unallocated and 
uninitialized (status bits = 11) ; (2) allocated and 
uninitialized (status bits = 01) ; and (3) allocated and 
initialized (status bits = 00) . Before each preexisting 
instruction that accesses memory or that can change memory 

35 status, extra instructions are added to maintain the memory 
status array, and to use the memory status array to check for 
the errors of writing to unallocated memory and reading from 
uninitialized or unallocated memory. A state transition 



WO 93/00633 



PCT/US92/04672 



15 

diagram is shown in Fig. 6, which illustrates the three states 
a memory location can have, and how states are changed. 
State (1) is indicated by reference numeral 101; state (2) , 
102; and state (3), 103. The first bit of a status code 
5 indicates whether the memory location is unallocated; the 
second bit indicates whether the memory location is 
uninitialized. Memory locations in state 1 are unwriteable and 
unreadable; those in state 2 are writable but unreadable; and 
those in state 3 are writable and readable. 

10 The status codes generally begin as 11 (state 1, 

unallocated) , and during execution of the modified application 
program, change as follows: on a successful call to "malloc" (a 
c memory allocation routine) , the status bits for each byte are 
set to 01; on a successful call to "free", the status bits for 

15 each byte are set to 11; on a successful call to "realloc", the 
status bits for the old memory are set to 11, and for the new, 
to 01 (the bits for that part of the new memory that is 
initialized from the old memory is set to 00) . When the stack 
pointer is decremented, the status bits for the bytes on the 

20 stack now allocated are set to 01. When a byte is about to be 
written, the first bit of its status bits is checked — if the 
bit is set, an error is signalled, else the readable bit is 
cleared (since the byte will now be initialized) . Similarly, 
when a byte is about to be read, the second bit of its status 

25 bits is checked — if the bit is set, an error is signalled. 
As a special case, when a byte is about to be copied from one 
memory location to another, the read of uninitialized memory is 
allowed, but the destination is marked as uninitialized, so 
that a copy operation on a structure with uninitialized bytes 

30 such as those from compiler padding will not cause an error to 
be signalled. In the preferred embodiment, status checking and 
changing is handled by a group of specialized runtime functions 
• which are called at the appropriate points. 

35 Fig. 7 represents the entire 32-bit virtual address 

space and is not to scale. The memory region 300 at the bottom 
of the address space, which corresponds to the static 
information in the program, begins and remains in State 3. 
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Memory region 3 00 contains the instruction codes 301, the data 
302, and the BSS data 303 (data loader- initialized to zero). 
The bytes in heap 400, which are manipulated via the malloc, 
realloc, and free functions-, change state frequently. This 
memory is in State 1 to start, then goes to State 2 when it is 
malloc' d, and to State 3 once it has been written; it goes back 
to State 1 when it has been freed. Memory region 500 is 
available to the stack. Memory 500 is in State 1 if it is 
below the stack pointer. As the stack pointer moves down, 
parts of this memory become "allocated", and are in State 2. 
Once the stack is written to the status goes to State 3. As 
the stack pointer moves up, it goes back to State 1. It is 
possible to treat every movement of the stack pointer as an 
allocation or deallocation, and to call the same routines as 
15 are called for malloc and free. This causes significant 

performance degradation, however, because the stack pointer 
changes frequently. A simplified way to track the status of 
memory in this region with less status bit maintenance is to 
compare the location of the referenced memory to the stack 
20 pointer. Memory in this region and above the stack pointer is 
looked up in the status bit table; memory in this region and 
below the stack pointer is considered to be in state 1. The 
method of stack pointer handling by the preferred embodiment 
is: (a) On entry to a function, where a link instruction 
25 allocates stack space for the function's local variables, a 
call is inserted to mark this affected memory as state 2. 
(b) When an argument is pushed onto the stack, a call is 
inserted to mark the affected memory as state 3. (c) When the 
stack pointer is incremented (reclaiming stack space) nothing 
is done. This is tied to the method for looking up the status 
bits for a given byte, which employs the rule, ."if the byte is 
on the stack, but below the stack pointer, then ignore the bit 
table, and use the state 1 (unallocated) bits." (d) Calls to 
"alloca" are handled specially, and the affected memory is set 

35 to status 2. 

There is an additional complication for stack 
variables. Optimizing compilers rearrange code to increase 
performance; one of the optimizations that they make is to move 
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simple assignments out of loops. Sometimes this can result in 
an uninitialized stack variable being accessed, but, the result 
is not used. Unfortunately, a monitored program would not 
determine that the result is not used, and would signal an 
5 error. Such unnecessary signalling of errors is avoided by 
inhibiting uninitialized stack variable checks in optimized 
code by marking local variables in the optimized stack-frame as 
initialized (i.e., in state 3). 

The status bits for the memory from 0 to the top of 

10 heap 400 are kept in a first bit-array; the status bits for 
stack memory 500 are kept in a second bit-array. Virtual 
memory outside of memory regions 300, 400, and 500 is obtained 
for storing these bit arrays using the "mmap" system call. To 
locate the status bits for an arbitrary byte at an address, the 

15 method is: if the address is below the top of heap 400, then 
the bit index is 2 times the address; if the address is in 
stack memory region 500, then the bit index is the address 
minus address of the bottom of stack region 500, then times 2; 
otherwise, the address must be a special address, such as 

20 shared memory, and is ignored. 

The current state of a memory location could be 
indicated without the use of status arrays. The value stored 
at a memory location would indicate the status of that 
location. One particular value would represent the unallocated 

25 state (state 1) , another particular value would represent the 
allocated and uninitialized state (state 2) , and all other 
values would represent user data in state 3. Obviously, 
however, single-byte values to not have a significant range, so 
the values representing states 1 and 2 would often occur in 

30 valid user data, causing errors to be incorrectly signalled. 
This problem could be minimized by using two or four byte 
sequences to indicate memory status, reducing the odds of 
random occurrence, but then single-byte access checking would 
not be easily supported. For this reason, the use of one or 

35 more separate status arrays is believed to be preferable. 

The code for operating system routines does not get 
linked into the user's program. This code is thus not 
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available to be processed according to the invention, and the 
memory status monitoring code cannot be inserted. For this 
reason the monitor process must take special measures to track 
system calls in which the operating system accesses the 
5 program's memory directly. The same special measures are also 
taken to track the heap management functions "malloc", "free", 

and "realloc". 

These special measures are shown in Fig. 8, which 
shows a process for intercepting all of the calls to a given 

10 set of functions, by modifying the name of every definition 

(usually there is only one) of these functions, and replacing 
their old names with new names. Interceptor functions are then 
provided under the old names; these interceptor functions 
typically call the intercepted functions as well as having 

15 other code. Given a function name, f, and its desired 

replacement, F, which must not have a longer string length than 
f , each object file is scanned for external symbols (types 
N TEXT and N_EXT) named f . For any such instances, the name F 
is written over the name f. When the linker runs, the only 

20 definition of f will be thn interceptor function, and when the 
program runs the interceptor function f will be called in place 
of the original f , which has been renamed F. To support the 
name of F being longer than f , the string table may copied and 
extended, and then all of the old references, which are in the 

25 symbol section, are patched into the new string table. 

In the preferred embodiment the data sections of the 
object code files are expanded with extra dummy entries between 
each datum or array of data. These extra entries are assigned 

30 the status of unallocated and uninitialized, and aid in the 
detection of array bounds violations and similar data errors. 
The preferred embodiment also establishes a list of memory or 
datum locations which are to be watchpoints with which more 
comprehensive monitoring is to be performed. These additional 

35 aspects of the preferred embodiment are described in more 

detail below. 

In order to detect many array bounds violations, 8 
bytes of memory are allocated before and after each array in 
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the heap, data and bss segments. These 8 bytes are marked as 
State 1 (unallocated) so that if the program accesses off the 
end of an array, it will access State 1 memory, and trigger the 
signalling of an error. For heap arrays, the status bits are 
5 set when the array is allocated. For statically allocated 
arrays, a special 8 byte value (unlikely to be encountered 
randomly) is inserted between each statically allocated datum. 
When the monitored program starts execution, the statically 
allocated memory is searched for occurrences of the 8 byte 

10 value. The status bits for each such occurrence are set to 

state 1. The error signalling routine looks for the special 8 
byte values to print more informative messages ("Array bound 
violation", in place of "memory access violation"). Stack . 
arrays are not currently delimited with the 8 byte markers, 

15 although they could be if so desired. 

There are some further complications with this method 
of tracking arrays, however. Occasionally, either the compiler 
or the programmer computes the address of the end of an array 
and uses it as an upper-limit pointer. If the array is defined 

20 in the same file upper-limit pointer is used, then the 

relocation information provided by the compiler is identical to 
that provided for a reference to the beginning of the next 
array. In general, any link-time reference to an address 
between two data could be intended as either to the end of the 

25 first datum or to the beginning of the second. When the data 
are separated, as described in the preceding paragraph, those 
'two points will no longer be identical. Almost always, the 
reference is to the beginning of the second, and that 
assumption can be made. It is possible to implement a check to 

30 determine if the reference is used solely as an upper-limit 
pointer or not, and have the reference patched accordingly. 
Another alternative is to allow the programmer to suppress the 
insertion of the 8 byte data separator in files that use an 
upper-limit pointer for locally defined arrays. 

35 Watchpoints are implemented by setting the read and 

write status bits of the bytes to be watched to 11 (binary) and 
by adding the location of the watchpoint to a watchpoint list. 
When the error signalling routine is called, the address being 
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checked is compared against the list of current watchpoints. 
If there is not a match, the error signalling routine continues 
normally. If there is a match, then the status bits to be 
manipulated are in a watchpoint-specif ic data structure, and 
5 the error routine calls the watchpoint routine, which typically 
prints a message, and returns without signalling an error. 

The above described memory access monitoring of the 
preferred embodiment is implemented by the methods illustrated 

10 in Figs. 4 and 5, wherein the formation of new code blocks, 
step 130 of Fig. 4, is performed according to the method 
described hereinbelow with reference to Fig. 10, and wherein 
function definitions of operating system routines that access 
memory are intercepted as described above. Also, the original 

15 initial entry point to the program is redefined to point to 
monitoring setup code, which when finished, transfers to the 
original initial entry point. The monitoring setup code is 
thus the first code executed in the modified executable 
program, and establishes the memory status arrays. 

20 Referring to Fig. 10, for this formation of new code 

blocks, block 130.1 determines the processing of the item 
according to whether it is an instruction (part of a function) 
or a datum. If it is a datum, blocks 130.2 to 130.4 copy the 
datum into the new code block with a dummy entry before and 

25 after, to enable the array bounds checking described above. 
For instructions, it is determined in block 130.5 if they 
access memory. If so, block 130.6 adds an instruction to push 
onto the stack the memory address (es) to be accessed, and block 
130.7 adds a call to the appropriate special runtime function 

30 that will check and set the appropriate status bits as well as 
signal errors and handle watchpoints. Finally, in block 130.8, 
the item itself (the preexisting original instruction) is 
copied into the new object code table, and the procedure of new 
code block formation step 130 is completed. The remainder of 

35 the method of modifying the executable program and monitoring 
its execution is as described above with reference to Figs. 4 
and 5. 
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Alternative Embodiments 

Rather than being added through object code 
processing, the instructions used to implement monitoring could 
be added in a compiler based or precompiler based manner, both 
5 of which have some advantages and significant disadvantages, 
however. A compiler normally generates during compilation all 
the necessary information to implement this monitoring; what is 
lacking, basically, is for the compiler to add extra code as 
illustrated in Fig. 10. The disadvantages of this approach are 

10 that recompilation for error checking consumes much more time 
than the above described object code processing, and that 
source code access to all involved libraries is necessary to 
ensure comprehensive and accurate error checking. A 
precompiler based approach, which would insert extra source 

15 code statements into source code files, would suffer all of the 
disadvantages of a compiler based approach, although it would 
have portability advantages. 

Yet another alternative approach would be for the 
invention to add the monitoring code directly into a previously 

20 linked program. Since an executable program has the same basic 
format as a relocatable object file, the program could be 
processed as one large object file. This would entail a more 
involved dead code analysis to distinguish data from 
instructions, and there would be both relative and absolute 

25 addresses to be updated rather than just relative addresses 
(offsets) . 

It is to be understood that the above description is 
intended to be illustrative and not restrictive. Many other 

30 embodiments will be apparent to those of skill in the art upon 
reviewing the above description. For instance, provisions for 
shared memory could be made, such as with yet another bit 
• table, but the bit tables should then also be shared, and all 
programs which access the shared memory should correctly 

35 maintain the status codes. Also, another example of a 
monitoring scheme especially suitable for implementation 
tnrough the above object code expansion would be standard 
profiling. The scope of the invention should, therefore, be 
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determined with reference to the appended claims, along with 
the full scope of equivalents to which such claims are 
entitled. 
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WHAT IS CLAIMED IS: 

5 1. A method for inserting new instructions into 

preexisting instructions, said method comprising the steps of: 

a) providing an old object code table containing the 
preexisting instructions; 

b) providing a new object code table, an inter-item 
10 offset table, a forward index table, and a forward control 

index table, said tables being for storing items in, said items 
having locations within said tables; 

c) performing the following steps for each item in 
the old object code table: 

15 i) storing a new code block into the new object 

code table, said new code block comprising any desired new 

instructions and the item; 

ii) storing the location of the item within the 

new object code table into the forward index table; 
20 iii) storing the location of the new code block 

within the new object code table into the forward control index 

table; and 

iv) for items which contain an inter-item 
offset, indicating the offset in the inter- item offset table; 
25 and 

d) for each inter-item offset indicated in the inter- 
item offset table, updating the inter-item offset, using the 
forward control index table for inter-item offsets which are 
for program control transfer, and using the forward index table 

30 otherwise. 

2. A method for inserting new instructions into a 
relocatable object file having preexisting instructions, data, 
and linking and debugging auxiliary structures having at least 
35 some offsets associated with the preexisting instructions and 
data, said method comprising the steps of: 

a) providing an old object code table, a new object 
code table, an inter-item offset table, a forward index table, 
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and a forward control index table, said tables being for 
storing items in, said items having locations within said 
tables ; 

b) copying the preexisting instructions and data of 
5 the object file into the old object code table; 

c) performing the following steps for each item in 

the old object code table: 

i) storing a new code block into the new object 
code table, said new code block comprising any desired new 

10 instructions and the item; 

ii) storing the location of the item within the 
new object code table into the forward index table; 

iii) storing the location of the new code block 
within the new object code table into the forward control index 

15 table; and 

iv) for items which contain an inter- item offset 
pointing to a target and referenced from a base, indicating in 
the inter-item offset table the locations of the target and 
base within the old object code table and of the offset in the 

20 new object code table, and modifying the item, if necessary, to 
be consistent with a maximum-byte offset; 

d) for each inter-item offset indicated in the inter- 
item offset table, determining a forward location for the base 
"using the forward index table, determining a forward location 

25 for the target using the forward control index table for 

targets which are program control transfer destinations and 
using the forward index table otherwise, and updating the 
inter-item offset in the new object code table using the 
forward locations of the base and target; 

30 e) updating the offsets in the auxiliary structures; 

and 

f) creating a new relocatable object file comprising 
the new object code table and the updated auxiliary structures 

35 3. A method for inserting new instructions into a 

relocatable object file having preexisting instructions, data, 
and auxiliary structures, said auxiliary structures having at 
least some offsets and comprising text relocation structures, 
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data relocation structures, and symbol structures, said method 
comprising the steps of: 

a) providing an entry point table, a new object code 
table, an inter-item offset table, a forward index table, and a 

5 forward control index table, said tables being for storing 
items in, said items having locations within said tables; 

b) providing an old object code table containing the 
preexisting instructions and data of the object file; 

c) for each symbol structure associated with a 
10 function and having a function entry address, storing the 

function entry address in the entry point table, said entry 
address indicating in the old object code table a first 
instruction of the function, the function also having a last 
instruction, all items between the first instruction and last 
15 instruction also being instructions of the function; 

d) performing the following steps for each entry 
address stored in the entry point table: 

i) performing the following steps for each 
preexisting instruction of the function indicated by the entry 
20 address: 

1) storing a new code block into the new 
object code table, said new code block comprising any desired 
new instructions and the preexisting instruction; 

2) storing the location of the preexisting 
25 instruction within the new object code table into the forward 

index table; 

3) storing the location of the new code 
block within the new object code table into the forward control 
index table; and 

30 4) for preexisting instructions that 

contain an inter-item offset pointing to a target and 
referenced from a base, indicating in the inter-item offset 
table the locations of the target and base within the old 
object code table and of the offset in the new object code 

35 table, and modifying the preexisting instruction in the new 

code block, if necessary, to be consistent with a maximum-byte 
offset; and 



WO 93/00633 PCT/US92/04672 

26 

ii) performing the following steps for each item 
in the old object code table after the last preexisting 
instruction of the function indicated by the entry address and 
before a closest next entry address: 
5 1) copying the item into the new object 

code table; 

2) storing the location of the item within 
the new object code table into the forward index table; 

e) for each inter-item offset indicated in the inter- 
10 item offset table, determining a forward location for the base 

using the forward index table, determining a forward location 
for the target using the forward control index table for 
targets which are program control transfer destinations and 
using the forward index table otherwise, and updating the 
15 inter-item offset in the new object code table using the 
forward locations of the base and target; 

f) updating offsets in the auxiliary structures; and 

g) creating a new relocatable object file comprising 
the new object code table and the updated auxiliary structures 

20 

4. A method for signalling errors in substantially all 
memory accesses by a computer program, said computer program 
capable of accessing memory locations within a set of memory 
regions, said method comprising the steps of: 
25 a ) maintaining memory access status information for 

substantially all memory locations in the set of accessible 

memory regions; and 

b) for substantially all memory accesses by the 
computer program, performing the following steps: 
30 i) determining an access type of the memory 

access ; and 

ii) signalling an error if the type of the 
memory access is inconsistent with the memory access status 
information for the memory location accessed. 

35 



5. The method of claim 4, wherein memory access types 
include read and write, and wherein: 
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a) the maintaining step comprises maintaining status 
information indicating two states of dynamically allocated 
memory, said states being allocated and unallocated; and 

b) the signalling step comprises 

5 i) signalling an error if a memory location 

having unallocated status is accessed by a memory access of a 
write type; and 

ii) signalling an error if a memory location 
having unallocated status is accessed by a memory access of a 
10 read type. 

6. The method of claim 4, wherein memory access types 
include read and write, and wherein: 

a) the maintaining step comprises maintaining status 
information indicating three states of dynamically allocated 
memory, said states being allocated-and-initialized, 
allocated-and-uninitialized, and unallocated; and 

b) the signalling step comprises 

i) signalling an error if a memory location 
having unallocated status is accessed by a memory access of a 
write type; 

ii) signalling an error if a memory location 
having unallocated status is accessed by a memory access of a 
read type; and 

iii) signalling an error if a memory location 
having allocated-and-uninitialized status is accessed by a 
memory access of a read type. 

7. A method of equipping a computer program with the 
30 ability to monitor most of its own memory accesses, said 

computer program having preexisting code items, said method 
comprising the steps of 

a) for most preexisting code items the performance of 
which involves a memory read, adding memory read monitoring 

35 code located so that it. will be executed each time the memory 
read preexisting code item is executed; and 

b) for most preexisting code items the performance of 
which involves a memory write, adding memory write monitoring 
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code located so that it will be executed each time the memory 
write preexisting code item is executed. 

8. The method of claim 7, wherein the computer program 

5 has a structured representation constructed by a compiler, and 
wherein 

a) preexisting code items the performance of which 
involves a memory read or a memory write are identified by 
examining the structured representation; and 
10 b) said structured representation is augmented to 

include the memory read monitoring code and the memory write 
monitoring code. 

9. A method for equipping a computer program with the 
15 ability to monitor most of its own memory accesses, wherein 

memory access types include read and write, said method 
comprising the steps of: 

performing the following steps for substantially all 
relocatable object files for the program, said relocatable 
20 object files containing instruction items of preexisting object 
code, said instruction items having locations within the 
preexisting object code: 

a) providing a new object code table for storing 

items in; 

25 b) storing, for each instruction item in the 

preexisting object code, a new code block into the new object 
code table, said new code block comprising the item and 

i) memory read monitoring code for items the 
performance of which involves a memory access of a read type; 

30 and 

ii) memory write monitoring code for items the 
performance of which involves a memory access of a write type; 

c) updating offsets in the new object code table; 

d) creating a new relocatable object file comprising 
35 the code items from the new object code file. 
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10. The method of claim 9, wherein said computer program 
is capable of accessing a set of memory regions, said method 
further comprising the step of 

adding code to establish memory access status 
5 information for substantially all memory locations in the set 
of accessible memory regions, said status information 
indicating three states of dynamically allocated memory, said 
states being allocated-and-initialized, 
allocated-and-uninitialized, and unallocated; and 
10 wherein 

the storing step comprises 

i) adding allocation indicating code for items 
the performance of which would involve allocating memory, said 
code updating the status information for the allocated memory 

15 to be in the allocated-ar.d-unitialized state; 

ii) adding deallocation indicating code for 
items the performance of which would involve deallocating 
memory, said code updating the status information for the 
allocated memory to be in the unallocated state; 

20 iii) for adding memory read monitoring code, 

adding code to signal an error if the accessed memory is not in 
the allocated-and-initialized state; 

iv) for adding memory write monitoring code, 
adding code signalling an error if the accessed memory is in 

25 the unallocated state, otherwise updating the status 

information for the allocated memory to be in the allocated- 
and-initialized state if the accessed memory is not in the 
unallocated state. 
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